Some Test on Ad Revenue per Confirm Uplift Summary // 2023-08-14 14:34:29

Some Test on Ad Revenue per Confirm Uplift
For key_metric MARPC (Ad):
control value  = 0.38975
expeted value  = 0.42873
uplift         = 10.00%

for 50/50 traffic allocation we need to collect
sample_size_control: 107,232
sample_size_test:    107,232
--------------------------------------------------------------------
TOTAL SIZE: 214,464  || Approx. 120 days for daily 1,800 users
--------------------------------------------------------------------
T-Test, two-sided test
alpha = 5.00%
power = 80.00%